Searching PAJ 



1/1 ^— V 



PATENT ABSTRACTS OF JAPAN 

(1 1 )Publication number : 1 1 -338876 

(43)Date of publication of application : 10.12.1998 



(51)Int.CI. 



G06F 17/30 
G06T 1/00 
G06T 13/00 
H04N 5/76 



(21) Application number : 10-145245 

(22) Date of filing : 27.05.1 998 



(71) Applicant : HITACHI LTD 

(72) Inventor : NOJIMA HIROSHI 



i 



(54) METHOD AND DEVICE FOR RETRIEVING IMAGE, AND STORAGE MEDIUM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To enable a user to retrieve a 
video scene retrieval while paying his or her attention to 
the feature of each video object at the time of retrieving a 
video file encoded in a content base. 

SOLUTION: Stream separation is executed in a processing 
70 in registering video data, annotation information such as 
the feature quantity or the like of an image is extracted at 
every video content in the processings 71-73 and it is 
stored in a video information table area 51 as the video 
objects. The user designate a retrieval condition for every 
video object in the retrieval. When the aggregation of the 
plural objects is retrieved, the retrieval is executed by 
object unit and. then, simultaneous appearance property is 
judged, based on appearance time section information of 
the coincident object so that the video scene desired by 
the user is retrieved and presented. 
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(54) [%i»<9«»] BMfelftMi^Kt^lft^emclBAtl^ 



C57) im^l 

A^^§l^:^fi^cc^ iaa? i~7 3r-!j^^©3>7->hS 

4^ KDttiSf^PdIKrate«47cK:|g^m3St4€:*(IK-r 




(2) 

1 

•c. 

3iNFraiziai«:Ki-rs*^«»*)te-rc i-cs^s^^ifefi^ 

ly^mm.ti,t. f!ffB7^-i'^-;^*><=.mo?*#7T 
[ft 2 ] if jRil 1 {ciBifi©?ft®«lsg:fr^{cteu 

ffi,«©iftife7 T '/•;w©tts©Era*tfem-r-2)$^a-c*-o 
r. 

^S^t?* ^) n > 7^ > h SK:??-^t a ti . B^^ic-^ 

fiS3n-r«^3n.&/ca)©^=i>-?-> n§i±©Mi^tf$8 40 

«^B|5lJ»S*3J-:/5^* h©m«ifriBT ^-i'a > 
*«Jffl^*i^M©St«S^->«r«l^-r6BStc. 50 
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nS^«-?>!B5(*^j: i'©l*«©«fiS!^S(c*©?$@[:&i3^ 

cn^wiaai© 1 ojii±©ia*^*5#*^6)&:€.ei5»t^5^ 
S!riB^giu?cift«g*:t:7'i^*i' h©aiaaB$paKP^cc5a 

[W*314] ii*^3CciBt£©i*0©^^^S«:*sii 
r. B5lBK«^^:*-7'i;^a:i^ h©t»ia?r7'-f'<-::^K: 

r5i^xmmLxi6<^mt. 

#M®^©s^R*^f:^ce•BR. eit«e^->©4>-c— j£^ia 

SiHS*Jiac»ili«!&S|^t»fcl^«-e©itBi© 1 o©;5>:&Btt 

mmm^-:fV':x.i7 v^tkmthmvi-^^<o^tiyx 

f BiE-r S C i *SpJfr6 «c r ^- a >fS«*«irtB =J > 

>hA^6faajL/. BUSBS^^SSR^t/S^xi' ^©tf#R<t■e• 
L . Cinh ©IB5B© 1 -:>W±©Mi»>^to-a-*i htj: i>m.^ 

fijffl^j&Jffi^s *i/c«i5i^s ;^ h ttJ©gfM©lft«->- 

•&<!:, B?iiB7^-if'<-^*^f>*f^©ftf^7r 

[^HJ©S¥iW^ClftlB] 
[0 00 1 ] 
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(0002) 

Jt^cc. ^m<oM.mL. f^»<Dmi'mm. ^mam^^) 

[0 0 0 31 ia^®'f'-i''<-;:^'^a->;:^'f-A-C«. » 
jh!ii«K:RlL.-c«> ^SiltStcff-?sn?c+-'7- 

mc^L«:t»«>©iL/-C«lS^{Ct 5> hLfc3&><t'^3ep* 
ESUUfcO, *^.mi«l^iS*©-fl«:fiJffl^'^li^-r 
•2) ^(cSIHa©*^ ^JK{c^-<# A-c^^ U -c «ls^©5a)^ 
|oi±*H<bi';^7"A*!, #g|^9 - 1 9 6 1 5 

[00041 c c -cm^tc^ -5 m»(omwiMi:mm 

■C*.5.. e*Slfe->->©«fiSS3Rr'&.2>— a©7U-Ail 30 

is^i L-rfflw 0. €tie>©f^aia«*±^©»±ii« 
naii««isg*iiDTfijffl#©MSi©et«*«i^-r 

fc?ft^©Sif.tf f8^K^©|2:raK:Ma«i:f e.nfcay > 

teat ^^mffimm-c * s j: ^ 

[0 00 51 40 
l^m^f^^OJ^'y^-rh^) c©J:^)JS:. ?*»©f^ 

*©:^^«ctei^r«. yj©<t^^cpfls*s*.s. 

[00061 l^»i^->©f^ll*=&fflC^/tii5^*ls^-C 
«. !!li«**S«SKS4Sii«,l^©*S-l^.^,©»±li« 

l>.S!!*5«'>->©-f>-i>iS^j:*Cifc4>»). f^H 

50 
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[00071 m^ii. i?m©*-cia(**s^*^6ac-v<!:^ 

6*^©^i**^^-oT:t,^-5B#(c, wm/<:W*'('^--:^bt: 
iii^«l*€rtf -3 AUt^Kjj. f^iaiii»*©!a»©l?SE 

[00081 ic^-c. T >f;i'©t?^<b:&^© i 

r b 5 ti. mm<Dmm(Oy>. h u - a i u r tt^ 3 ia 
©eniRx h v-j^ifi-^mnMstix 1 o©e^isi urw 

i)m^it^inXi,^^m^X$>-oX'b. 3>7^>h©&fiS 

»©i}^w«Sr7c{c L/rse*©:^-c!fc»^- n omm 
n$ xmmic^mam l < ^cs i Rgs*i* o •5, 

[ 0 0 0 9 1 2|s:fEig©Be<J». =i>^> h-t-XTl?-^ 
A«:*jt,»-r. ^|Jffi^*J?!l^^^c^i♦^n^.^i■^?©^>■?•> h 

•6. *^i^©Wia^i6wc^©flfe©aK)So'if«^t#sit 

[00101 

[ss*iB9i-rsfcfe©^si *igiK:*jt,>rpB^n?ns 

T©<!:*J<9-C*S. 

(1) 7'-df'<-;^K:eii«7r-Y^l'41^l/> ff«©Sft 

^^T-Y Ji'©ffi;t©isp5^t^s-r-5:^s-c*o-t, it^s 
i5!±©Mi?^tt$g*j#-p-rt<^-2)eft«7T '('Ji'©x h 'J -A 

mm^tzTiyx.^ hi:^m-ri,f^.K.-^m<o^f¥tLx^ii^ 
*sBfM©tt«E->->*«i^-rsi^«:. eifcis{cii*>n-5?¥ 

ti6©IB^© 1 •otl±©ffl;5^-&*5-li*'e.^c^|^t^|sg© 
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[0 0 1 1 ] ^mn<o^^^>vu. m^u. 

[0012] ( 2 ) BaiBB*«^^:t7'-:^» i' h©ti$R* 
^_5r^-X(c^i-r.SI^. e^«i/->©4J©«F®W)&: 

^SiltS©±f*W^c&^iv ©Hife<j>ife^c^ x-;'yit 
fK/j:<i:©)B*f^m€:il«!^®«i 0-C|SH«i'->tcHJi 
-:rwcS8lLr*j#. iBtR©a<Kat*3g*5cK:br!!*^ 
«fes^*tf ^^©*^^B##Ma»©jSf?:^ffi t , 
«->->©iiJ-c— ^B#raiapi«{ciiits©iti^?r?fAj:i,\ 

Sm*sjSl»iffi«*siKl>fcmi-€-©5tII© 1 •o©*4g^[ 

i*^i^->©*is^#MBi«i \^-cum-r^mti.^imi5 

[0013] ( 3 ) «(rfBlfefi!S'->©«l*ie#MffiHS!© 

msv3m^. >©gt> tc?*^©«fi£^m-c* 

[0014] ( 4 ) miiBe>l«3 >7"> Vifi. S^Bf tcffi 
JS^k:. BfiiBeft^=i>5"> h©«I^B##Milfife©ia^1t 

r*5#. j§jfjrtiij^!^ffia*i5^^sim©*f3ii^g<!:-rs 

[0015] ( 5 ) t5iSJ§J^l^il^!|$S4S©fittBcDBg. 

B^^gei^s^rfe^EJf^©M'l:^fiigK: <fc o 2>7ciiie^rt© 

[00 16] (6) Btiffil»5»S3R:i-:?'i^ii' h3!>s^+;^ 
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c -r ■£> 5*^«*-:^te cfc -5. 

[0 0 17] (7) 7'-d?-^-X«:5i^fiS7T-{^l'«rS^ 
ff5t©!Sl5»7 r ;U©ffS©IEiaiSr1J^S^r SKgr 

^B^K^fiE 3 n-C«^n 3 ti •£ ft:«t>©S[ 3 > 7^ > Hil±© 

©i. c©iK*TK:j:9^iitsnr}ffiwsnfcS«3>7" 

10 > h ^-f-ii^n 1 -^©8ft«SiR* -/y i f h i L , 

^S^*:?"-:^* ^' h =&«l*-r^lSK:^a©^ft=i L-TIB 

?fJffl#*5BFfM©B!^#'>->^tj^^-r^fiKK:, 

i*^fc^t)n^.WS-?'!^(*'it'©?fcfil©«fiS!|as«:-?-© 
^Si^iB^-r*^® i . C ti6©IBa© 1 -:>«±©iffl* 

[0018] ( 8 > mrSa!ft«S^:*-:/t>x h©if««: 

•r-5?'<-xtcMir5l^, |s^^'>->©i^>©!^@:6<jAj: 

7 u-A©ia«4t^i*^^fiii L/Tjaai-ri.#ia 

HqsBil»©^«:fl«J«cfe-&C». wmWt^^\.^. 
30 t^Wfa'&:i'©ft?*fiSIR*ia»#8![*iL/TW«>'->K: 

'^^s ?*fife->->©*-C-^KJrara|i§S{Ci®»©J:bf5* 
?f^C^>^e<!:. ®m*s;i5(,^ili«!*^C»/cB#W^©5fegI 
© 1 o©*'*«!ftBe«l^St''->©«l3^^#M®«i btrs 

[0019] ( 9 ) msmfSt.^ h©«©«l3^B$# 
MiS»©SHKS*^*K: J: o-C'T- i"^-x>tJ©|fteiS5g 

40 -^^$nTfl^3n€.^«->->?:B*«*l^©!gmi^ 
[0 02 0] (1 0) miffi!Mfe3>7->h*i. S^^CC 

fcti^K:. !!MR3>7^>h©«l5feB##JSii»©iift!^® 
I^C »/cj^ J^«r5E« O . gEJ€J^©rtS|5* 1 tSf©Bi» t * 

L-cHi»!^mB©^tii^tf 7=- :5? X i^mt^-r h 

50 ^Si. JS§}K(^iSfil#Sifi*8fe»«l^©*fl^^e<!:-r.5 
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[002 1 ] (11) B?iBSi?fJ!^iii^15i!iS®Stil® 
[0 02 2] ( 1 2) h*57- + X h 

[0 02 3] ( 1 3) 7^-i»'<-X«:|ft«7r-fil'%a 
<DSJiS^IIS*3 > f * - tcHtfS i^^ A?ri2 

T-> h?r^n*ni-:>cD8fe«^fg:=f--^i^*i' h<tU. I* 
^gc*iJK^tfiiii-\ ^ScL/cB*«giS:i-:/t>*i7 h©ffi 

3SB$raB:ratcKi-r sai^ingc^js-rc i-c«is^iB:^i*« 

©0fS©?*i«t'->?:fi^-r.S<!:, itrf2f'-^-<-X*:> 
S a d/-7 A^IBSi U/c=i > b- » "5 Blfit&iE 
[0 024] 40 

sufe©}^!!! mmm) iw^mtc^m-riy. m 1 

[0025] **SS}i5®©f'-^'<-;^i^X7^A«. a 

1K:^TJ:^{c. i'7-f'T> h -■!f-^<^©'>;^f-A-c 

iijtifiiA^ja^a ( ^ 7 T> h ) 10 tmmtk^^ 
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^->;^-5^A5 0. S^5^ju-JKC*Jl:t-5J!ia3ag©f' 
?:-Blje«)fcS}^U-Cte</i:8t)©— 6 0. R 
O'ii <7 ©SftSl^r ^ - Jl/*> P) >i -5 . 
[0026] ffrfBftia*5^*->l' i L-c 

Miiifi^f#*as*i^*-Ji'7 1. iStfei^S^taffiS* 
t>»-;U7 2. httffigS{»*ttS^i;»-Jl'7 3. 

[ 0 0 2 7 ] 0 1 «:*5t»-c. K«©7'-4»--«-;^l^^ 

■9-— '>*$ig3 0K:eji3ns. ej^<!:W*)t<«ejii 
^T^^tc, s*#*t^^-rs/ci?)©tffg*ei«©**^e>ffl 

HJU. lft«gfg$IS4 0©iSji/j:iS^f^-< ;^ i'T^^^ 
T Jl'«iW^«4 1 ©7=-ar-^->^{ci^-r 

[0028] M:t^6^iCit. h <J -A|gW«iffl*SP 

a-jb? ot?8ft«*>^ h ')-A<o^$m»(icm-rctK. 

cfco. i*tl!;=^ h y-A. h y-A. t-^jj^ h • x 

h'J-A. ^©ffi©ll-*©|!Mfe7y-C;V34g©X h 

cn6«:>Ptl/. h©aSK:*tiSL.ytJB9T*JJ; 

[0029] h U-A*>6<i*lft»SlS:t:?'y:t 

i7h©ia^«, «l^^#MiiiffeIXfS^Kiil*i^*-^l'7 1 

Sik-rsi i *©|ft«x h y -Ai*3©^®e«)Aj:|Ji^ 

7U-A^#±iij^iU-CjftaiU. cn6?:t^^^#M 

[0 030] ItStCWtllX h - A*iSStB#(C^ES3n 

M*a-^toti-©Bg{c, -:^©x h y-A-ctJ 
mtti^h<Dxs>i>. ccx^mmmmmi^iciii^x 

*i<t'5J&>«:*I»r-rS/<:»©T;U7r • :/U->S-C#ffi 

u. iiim#mss[ad©B5tcS3saj^}*i^*Lrte<. c 

[ 0 0 3 1 ] */c. ii«!t$sai©ai*3S*y *-;i'7 2 
«:*$wsiri2illS!|tStfi©ffl©l«K:B. Siagp^iS:^ 
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[0 03 2] fjiid. ^ito:>^^^^^mt':fV^:x:^ h<0 
[0 03 3 ] r-^T. h • ;^ hV-Af)^^rj::Bmi^mmt 

[0 034] h v-ju^m^(D^i^yr>(j\^i^n 

^©X hy-A(Dl§>&B#g(|. i*7^^JiXhV-A 20 

[0 03 5 ] 3>7"> h^-;^rtg^{b$n/c?ft^^i^ 

[0 03 6] ?ft»«l^*2;S^e;^:x-;l/8 0 
:^^pJfig^3^j:'So 40 

[0 03 7] mmmxtiWrnm 1 0 e^:7 r 
h 9-^7 9 0ig4rei^t^i5fei?--^<jgg3 otce^$ 

[0 038] tyi2^«t^^S^^g2 0 R^:7 r ^ 
tf^t>tl^o 50 
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[0 039 ] tuiBSft«sasia4 o^«. mmxtf^^ 
[0 040] tuiaf'-i$?-^-;^gs>^;^rA5 oris. 

[ 0 0 4 1 ] 0 2 tiBjjii^tf $S7"- :/;U^i^5 1 r^S^ 

^i^i^->gil-r-:/;l'5 6. x^;^ h -T^t— ->3> 

[ 0 0 4 2 ] 0 3 {JBj^i^:? T 5 2 <D« 

<0^m=F^^t>ry r >f ;H D 5 2 1 . Blti«:7 T 
t&SS^tiTl^5liB^^fif0ij^*rmSElt^R5 2 2. B^r; 

if®jii4tf«5 2 3, ^(DStftccM-r^sf^fti^. Has 
^mr^mmnm5 2 4i)^$>^. yr^ji^iubziu 

[0 043] S4«:t:^t^Ai7 hl?ilf*-:/>'l^5 3©«t 
la^fl-r^^^e^x^ h I D5 3 K •e<D:^-:/S^^t> 

i'cD:? r ^ jviicm-t^otf^^^ry T -r;n D 5 3 2 , 

h I D 5 3 3 . ^(OW^^n^':^'^:^ ^ h 3^»ii5^«:^j:CD 

dtZfiy:^:^ hCDaS^^3b-r:t:/i^*^ hSittS 3 4. 

F5 3 5S0f$l7d7^Ar3-K5 3 6:^cC<*:>^^^o 
iy:^^V XDbZlt. r ^ JH D 5 3 2 <t a>f-> 
h I D5 3 3i«riHtCL//c4>©i*^. 

n>7^> h I D 5 3 3 CCOlir«. B*^:7 r -0^(0 

CC^dC^rtt^-^Arn- SMP T EffJ^i Uri^^ 
[00441 ^5 ««I^B$#Sgiij«§Sr"- 5 4 (D 



(7) 

XI 

/c «3 i t ^ o fcmn^mj: ^Ctifihh. 10 
[0 04 5 ] ccr». r)\^yr ' y'u-^tiit^f&dBt 

[0 04 6 ] T*-:/JKD:^7^A<tUr«. «IS5B##Ml® 20 
#^i^iJ-r-S/ce5?>©®« I D 5 4 1 . ^0)y 

h I D 5 4 2 . ^CD:7 U- Aj&sK 
ff$tl/c^r^^^^T^-YAr3-F5 4 3. ^(Oyx^- 

j^m^o'B^^m^'Tm^y^t-'^vVbAA. yv- 

-V h 5 4 4 ^WSC^W 5 4 5 Il«!f#StSStH<D 

'imt^tiUx.^. U/c*^or. 11^:7 ^-^•i' h 5 4 4 30 
SCfll«*t*5 4 5 :^?'7A;&5c©f'-:/;UtC3g:< rfc. 

[ 0 0 4 7 ] ^ 6 t3:*>C^1«$Bl?8if-- r^^U 5 5 

'Scfc^^j::t:/i^3.^ h^§||Lr«. 1 -:><Dlli^ I D^c>r^ 

[0 04 8 ] ?^cc;fe. T;l/r?T • r^'U-VcbO^^^ri^t^ 

- y ;KD:<7 ^ A <h L r ^m^#ffSia»^a7" - ^ Jl' 
54©iBIRI D*r^A(C«j£*rSiii«I D5 5 1, X:& 

rS]Rt;fY:^rsjos^c^{4ig^^n-enO'-i o ocDiSHtc 
tiO- 1 0 OODfiH«:jE«{tL/c7&5. iiiffi±«:*j&:t-5tB 

n^m.m^'&x^h^m&^xhtwt. mm-^xth-^ 
x^:^^^(D'msm\tm.\^^^u\.K so 
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[0 04 9] mi\m.m^-ly'^mrr-^)\^^ 6CDm^ 

-^cDlsr^tf$B<tf^:7 u-Aiii«^^S*r^/c2^(Dfe(D 
lifter- :>SJiB#«:i5t^CD^ ^ftimr 

[0 0 5 0 ] -r-:/;l'(D;^7^A<h Urt^, B!ft^>'->^ 
iaS«-r'5/ci&©i/-> I D 5 6 K Stit^'-XD^^n 
59i«:7T>f;l/^^*rift»:7T-<Jl/I D5 6 2. 
->CDB$remPa ^5 *^-ri§te^ A n K 5 6 
3. ift»t^->cOB#PaEra©*^t)0?r*-r*&7^-<A=J 

- F5 6 4. v<m,y u-Aiii^^&axftu/c^pa^?^^^^ 

a^H^An^K5 6 5. lXf#L/cf^:7U-A(DIij^?fJ 

'&m.^txx\.^UKmf^i^->. h^\.Ax^^mmm^ 
to 0 5 1 ] astif-^:^ V • ryT-^yB^mmf— 

':^)Vb7<omfSimx^^o r'-^>'UCD:^^AiLr«. 

Sflf -s/cibcct^^x h I D5 7 1 , -e©^^^;^^ h • r./ 

c^*^iMA#^cfc o xmn ^ tifc ^(Dx$> ^ fcm^(c ^ 
om^y r ^)V(tcm^^t^i>(oi>^^7jk'rVkmy7-()V i 

D5 7 2. f-^^^h ' ryr^-iyB>f)mm^tifcmii 
IEP^^^'r^JS3r'YAn-K5 7 3. *^Ti5?-rAn--K 
5 7 4. ^LX:iCTzi^\:fil^(Dh(Dffi^m^tl^f'^ 

<Dv^^:^b - x h';--A7&:»e>a«)WtcffltH'r-5>fife. 

[0 0 5 2 ] ^ 1 *cO§A!V®tcoi,irUiHJ-r^o 

*0!a7O--7 4«. i&cS*^:7T w^J^^B*^f^'-:$^-=^- 
[0 05 3] <mi^y r ^ )V^mim(Oi^tf)^rj:^ti> 
mmy r ^}l<0^[t. ^i^y r -01^(0 i>(0(DWm^ 

m^oi^w. ^myr^)\y^t(omf&mmx$>^::i>7' 
> hcc>; h v-M.^m^nrj:^fc±x(D^mmm:f:ri^ 
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[005 5] ll2cDffiS. rtJit>^. ^Ski^trfty:^^ h 
[0 0 5 6 ] macDMtS. -TJit)^. l*«5^-->ttfRO 

^1 0;j?:»^3i6nT3S^ife^>'T>r;i/^iiB#r^iajiL 

to 0 5 7 ] &.±j^-<tc3-o<DmmmiiC^^x. mm 
[0058] <m^v r A }\^(ommv r -< }\^wst^m^^ 

cxm^^^^^nfcmmyr^M^msSit^irifj:^^ti\tts: 

[0059] <mmmmt:ri^:^^ hmn(D^m!i!m> 
mmmm^ '^m.(o^mJ9mo:>y u-^^-v 

[0 0 6 0 ] S9Cr)X7^';^:7*7 0 0 or. — B#>^y6 
[0 06 1 ] ^<Xf--^:/7 0 0 1 -C;^ h 'J -ACDM^iJ 
-A. ^— »f^«X h U-A>^^*s*-5>o lfe«<D 

h v-Mmmmm<o^<Dibsu&bxBm^tix< ^ 

ii(OX$>^^ ^l^cDX h y-Ak:*f-r€>«&Sti*5fe3fetf 

wcj?). &.T(ommiLt 1 o 1 -:><d;^ h - A*{4tcfaai 

[006 2] ;:^f-^^:/7 0 0 2refe«Xh V-Atm«i 
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